Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fixes https://github.com/flairNLP/flair/issues/3623: save PEFT config… #3627

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

MattGPT-ai
Copy link
Contributor

Fixes Flair bug: #3623

This simply saves the PEFT config to the transformer embeddings object and exports it as a parameter so it is saved with the model file and loaded when instantiating the embeddings.

…xport as param so that it loads correctly.
@MattGPT-ai
Copy link
Contributor Author

We might actually need a way to load a model in inference mode so that it can set inference_mode=True in a model that was saved after training but is being loaded for inference. It would have to set that in the peft config after it was loaded in the state dict but before it was provided to the model instantiation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant